Theory of Interaction of Memory Patterns in Layered Associative Networks

A synfire chain is a network that can generate repeated spike patterns with millisecond precision. Although synfire chains with only one activity propagation mode have been intensively analyzed with several neuron models, those with several stable propagation modes have not been thoroughly investigated. By using the leaky integrate-and-fire neuron model, we constructed a layered associative network embedded with memory patterns. We analyzed the network dynamics with the Fokker-Planck equation. First, we addressed the stability of one memory pattern as a propagating spike volley. We showed that memory patterns propagate as pulse packets. Second, we investigated the activity when we activated two different memory patterns. Simultaneous activation of two memory patterns with the same strength led the propagating pattern to a mixed state. In contrast, when the activations had different strengths, the pulse packet converged to a two-peak state. Finally, we studied the effect of the preceding pulse packet on the following pulse packet. The following pulse packet was modified from its original activated memory pattern, and it converged to a two-peak state, mixed state or non-spike state depending on the time interval

Sparse and Dense Encoding in Layered Associative Network of Spiking Neurons

A synfire chain is a simple neural network model which can propagate stable synchronous spikes called a pulse packet and widely researched. However how synfire chains coexist in one network remains to be elucidated. We have studied the activity of a layered associative network of Leaky Integrate-and-Fire neurons in which connection we embed memory patterns by the Hebbian Learning. We analyzed their activity by the Fokker-Planck method. In our previous report, when a half of neurons belongs to each memory pattern (memory pattern rate $F=0.5$), the temporal profiles of the network activity is split into temporally clustered groups called sublattices under certain input conditions. In this study, we show that when the network is sparsely connected ($F<0.5$), synchronous firings of the memory pattern are promoted. On the contrary, the densely connected network ($F>0.5$) inhibit synchronous firings. The sparseness and denseness also effect the basin of attraction and the storage capacity of the embedded memory patterns. We show that the sparsely(densely) connected networks enlarge(shrink) the basion of attraction and increase(decrease) the storage capacity

Changes in corticospinal excitability and the direction of evoked movements during motor preparation: A TMS study

BACKGROUND: Preparation of the direction of a forthcoming movement has a particularly strong influence on both reaction times and neuronal activity in the primate motor cortex. Here, we aimed to find direct neurophysiologic evidence for the preparation of movement direction in humans. We used single-pulse transcranial magnetic stimulation (TMS) to evoke isolated thumb-movements, of which the direction can be modulated experimentally, for example by training or by motor tasks. Sixteen healthy subjects performed brisk concentric voluntary thumb movements during a reaction time task in which the required movement direction was precued. We assessed whether preparation for the thumb movement lead to changes in the direction of TMS-evoked movements and to changes in amplitudes of motor-evoked potentials (MEPs) from the hand muscles. RESULTS: When the required movement direction was precued early in the preparatory interval, reaction times were 50 ms faster than when precued at the end of the preparatory interval. Over time, the direction of the TMS-evoked thumb movements became increasingly variable, but it did not turn towards the precued direction. MEPs from the thumb muscle (agonist) were differentially modulated by the direction of the precue, but only in the late phase of the preparatory interval and thereafter. MEPs from the index finger muscle did not depend on the precued direction and progressively decreased during the preparatory interval. CONCLUSION: Our data show that the human corticospinal movement representation undergoes progressive changes during motor preparation. These changes are accompanied by inhibitory changes in corticospinal excitability, which are muscle specific and depend on the prepared movement direction. This inhibition might indicate a corticospinal braking mechanism that counteracts any preparatory motor activation

Functional identification of biological neural networks using reservoir adaptation for point processes

The complexity of biological neural networks does not allow to directly relate their biophysical properties to the dynamics of their electrical activity. We present a reservoir computing approach for functionally identifying a biological neural network, i.e. for building an artificial system that is functionally equivalent to the reference biological network. Employing feed-forward and recurrent networks with fading memory, i.e. reservoirs, we propose a point process based learning algorithm to train the internal parameters of the reservoir and the connectivity between the reservoir and the memoryless readout neurons. Specifically, the model is an Echo State Network (ESN) with leaky integrator neurons, whose individual leakage time constants are also adapted. The proposed ESN algorithm learns a predictive model of stimulus-response relations in in vitro and simulated networks, i.e. it models their response dynamics. Receiver Operating Characteristic (ROC) curve analysis indicates that these ESNs can imitate the response signal of a reference biological network. Reservoir adaptation improved the performance of an ESN over readout-only training methods in many cases. This also held for adaptive feed-forward reservoirs, which had no recurrent dynamics. We demonstrate the predictive power of these ESNs on various tasks with cultured and simulated biological neural networks

Statistical Significance of Precisely Repeated Intracellular Synaptic Patterns

Can neuronal networks produce patterns of activity with millisecond accuracy? It may seem unlikely, considering the probabilistic nature of synaptic transmission. However, some theories of brain function predict that such precision is feasible and can emerge from the non-linearity of the action potential generation in circuits of connected neurons. Several studies have presented evidence for and against this hypothesis. Our earlier work supported the precision hypothesis, based on results demonstrating that precise patterns of synaptic inputs could be found in intracellular recordings from neurons in brain slices and in vivo. To test this hypothesis, we devised a method for finding precise repeats of activity and compared repeats found in the data to those found in surrogate datasets made by shuffling the original data. Because more repeats were found in the original data than in the surrogate data sets, we argued that repeats were not due to chance occurrence. Mokeichev et al. (2007) challenged these conclusions, arguing that the generation of surrogate data was insufficiently rigorous. We have now reanalyzed our previous data with the methods introduced from Mokeichev et al. (2007). Our reanalysis reveals that repeats are statistically significant, thus supporting our earlier conclusions, while also supporting many conclusions that Mokeichev et al. (2007) drew from their recent in vivo recordings. Moreover, we also show that the conditions under which the membrane potential is recorded contributes significantly to the ability to detect repeats and may explain conflicting results. In conclusion, our reevaluation resolves the methodological contradictions between Ikegaya et al. (2004) and Mokeichev et al. (2007), but demonstrates the validity of our previous conclusion that spontaneous network activity is non-randomly organized

Structure of Spontaneous UP and DOWN Transitions Self-Organizing in a Cortical Network Model

Synaptic plasticity is considered to play a crucial role in the experience-dependent self-organization of local cortical networks. In the absence of sensory stimuli, cerebral cortex exhibits spontaneous membrane potential transitions between an UP and a DOWN state. To reveal how cortical networks develop spontaneous activity, or conversely, how spontaneous activity structures cortical networks, we analyze the self-organization of a recurrent network model of excitatory and inhibitory neurons, which is realistic enough to replicate UP–DOWN states, with spike-timing-dependent plasticity (STDP). The individual neurons in the self-organized network exhibit a variety of temporal patterns in the two-state transitions. In addition, the model develops a feed-forward network-like structure that produces a diverse repertoire of precise sequences of the UP state. Our model shows that the self-organized activity well resembles the spontaneous activity of cortical networks if STDP is accompanied by the pruning of weak synapses. These results suggest that the two-state membrane potential transitions play an active role in structuring local cortical circuits

Coherence Potentials Encode Simple Human Sensorimotor Behavior

Recent work has shown that large amplitude negative periods in the local field potential (nLFPs) are able to spread in saltatory manner across large distances in the cortex without distortion in their temporal structure forming ‘coherence potentials’. Here we analysed subdural electrocorticographic (ECoG) signals recorded at 59 sites in the sensorimotor cortex in the left hemisphere of a human subject performing a simple visuomotor task (fist clenching and foot dorsiflexion) to understand how coherence potentials arising in the recordings relate to sensorimotor behavior. In all behaviors we found a particular coherence potential (i.e. a cascade of a particular nLFP wave pattern) arose consistently across all trials with temporal specificity. During contrateral fist clenching, but not the foot dorsiflexion or ipsilateral fist clenching, the coherence potential most frequently originated in the hand representation area in the somatosensory cortex during the anticipation and planning periods of the trial, moving to other regions during the actual motor behavior. While these ‘expert’ sites participated more consistently, other sites participated only a small fraction of the time. Furthermore, the timing of the coherence potential at the hand representation area after onset of the cue predicted the timing of motor behavior. We present the hypothesis that coherence potentials encode information relevant for behavior and are generated by the ‘expert’ sites that subsequently broadcast to other sites as a means of ‘sharing knowledge’

STDP Allows Fast Rate-Modulated Coding with Poisson-Like Spike Trains

Spike timing-dependent plasticity (STDP) has been shown to enable single neurons to detect repeatedly presented spatiotemporal spike patterns. This holds even when such patterns are embedded in equally dense random spiking activity, that is, in the absence of external reference times such as a stimulus onset. Here we demonstrate, both analytically and numerically, that STDP can also learn repeating rate-modulated patterns, which have received more experimental evidence, for example, through post-stimulus time histograms (PSTHs). Each input spike train is generated from a rate function using a stochastic sampling mechanism, chosen to be an inhomogeneous Poisson process here. Learning is feasible provided significant covarying rate modulations occur within the typical timescale of STDP (∼10–20 ms) for sufficiently many inputs (∼100 among 1000 in our simulations), a condition that is met by many experimental PSTHs. Repeated pattern presentations induce spike-time correlations that are captured by STDP. Despite imprecise input spike times and even variable spike counts, a single trained neuron robustly detects the pattern just a few milliseconds after its presentation. Therefore, temporal imprecision and Poisson-like firing variability are not an obstacle to fast temporal coding. STDP provides an appealing mechanism to learn such rate patterns, which, beyond sensory processing, may also be involved in many cognitive tasks

Spike Timing Dependent Plasticity Finds the Start of Repeating Patterns in Continuous Spike Trains

Experimental studies have observed Long Term synaptic Potentiation (LTP) when a presynaptic neuron fires shortly before a postsynaptic neuron, and Long Term Depression (LTD) when the presynaptic neuron fires shortly after, a phenomenon known as Spike Timing Dependant Plasticity (STDP). When a neuron is presented successively with discrete volleys of input spikes STDP has been shown to learn ‘early spike patterns’, that is to concentrate synaptic weights on afferents that consistently fire early, with the result that the postsynaptic spike latency decreases, until it reaches a minimal and stable value. Here, we show that these results still stand in a continuous regime where afferents fire continuously with a constant population rate. As such, STDP is able to solve a very difficult computational problem: to localize a repeating spatio-temporal spike pattern embedded in equally dense ‘distractor’ spike trains. STDP thus enables some form of temporal coding, even in the absence of an explicit time reference. Given that the mechanism exposed here is simple and cheap it is hard to believe that the brain did not evolve to use it

Chronic Toxoplasma Infection Modifies the Structure and the Risk of Host Behavior

The intracellular parasite Toxoplasma has an indirect life cycle, in which felids are the definitive host. It has been suggested that this parasite developed mechanisms for enhancing its transmission rate to felids by inducing behavioral modifications in the intermediate rodent host. For example, Toxoplasma-infected rodents display a reduction in the innate fear of predator odor. However, animals with Toxoplasma infection acquired in the wild are more often caught in traps, suggesting that there are manipulations of intermediate host behavior beyond those that increase predation by felids. We investigated the behavioral modifications of Toxoplasma-infected mice in environments with exposed versus non-exposed areas, and found that chronically infected mice with brain cysts display a plethora of behavioral alterations. Using principal component analysis, we discovered that most of the behavioral differences observed in cyst-containing animals reflected changes in the microstructure of exploratory behavior and risk/unconditioned fear. We next examined whether these behavioral changes were related to the presence and distribution of parasitic cysts in the brain of chronically infected mice. We found no strong cyst tropism for any particular brain area but found that the distribution of Toxoplasma cysts in the brain of infected animals was not random, and that particular combinations of cyst localizations changed risk/unconditioned fear in the host. These results suggest that brain cysts in animals chronically infected with Toxoplasma alter the fine structure of exploratory behavior and risk/unconditioned fear, which may result in greater capture probability of infected rodents. These data also raise the possibility that selective pressures acted on Toxoplasma to broaden its transmission between intermediate predator hosts, in addition to felid definitive hosts